Papers with Maximum Likelihood Estimation
Reference Free Domain Adaptation for Translation of Noisy Questions with Question Specific Rewards (2023.findings-emnlp)
Copied to clipboard
Baban Gain, Ramakrishna Appicharla, Soumya Chennabasavaraj, Nikesh Garera, Asif Ekbal, Muthusamy Chelliah
| Challenge: | Creating a synthetic parallel corpus from noisy data is also difficult due to its noisy nature. |
| Approach: | They propose a training methodology that fine-tunes the NMT system only using source-side data to balance adequacy and fluency. |
| Outcome: | The proposed method surpasses the MLE-based fine-tuning approach by achieving a 1.9 BLEU improvement. |
Group-wise Contrastive Learning for Neural Dialogue Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to training dialogue models have low diversity in open-domain contexts . prior art suggests that naive MLE objective is not effective enough . |
| Approach: | They propose to incorporate contrastive learning into dialogue generation by using a pretrained baseline model as a reference. |
| Outcome: | The proposed framework is suited for training a wide range of dialogue generation models with favorable performance over baseline training approaches. |
Generating Reasonable and Diversified Story Ending Using Sequence to Sequence Model with Adversarial Training (C18-1)
Copied to clipboard
| Challenge: | Story generation is a challenging problem in artificial intelligence (AI) . previous work focused on learning statistical models of event sequences from large-scale text corpora . |
| Approach: | They propose to use adversarial training to generate reasonable story endings . their model includes a generator that defines the policy of generating a story ending . |
| Outcome: | The proposed model achieves better performance on the task of Story Cloze Test with an accuracy of 62.6% compared with state-of-the-art baseline methods. |
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Abstractive summarization systems still suffer from faithfulness errors, authors say . prior work has proposed models that improve faithfulness, but it is unclear whether this improvement comes from an increased level of extractiveness of the outputs. |
| Approach: | They propose a faithfulness-abstractiveness trade-off curve that serves as a control . they also learn a selector to identify the most faithful and abstractive summary for a given document . |
| Outcome: | The proposed model achieves higher faithfulness scores while being abstractive than the baseline system on two datasets. |
Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training (2025.acl-long)
Copied to clipboard
Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Jiahao Xu, Tian Liang, Pinjia He, Zhaopeng Tu
| Challenge: | Large Language Models exhibit a level of intelligence that is both impressive and everevolving, but their ability to refuse generating unsafe content is a double-edged sword. |
| Approach: | They propose a method to tackle a refusal position bias within safety tuning data that compromises the models’ ability to appropriately refuse generating unsafe content. |
| Outcome: | The proposed method significantly improves model safety without compromising performance and surpasses baseline methods in defending against attacks. |
Learning with Noise-Contrastive Estimation: Easing training by learning to scale (C18-1)
Copied to clipboard
| Challenge: | Neural language models have recently shown great improvement, but they share a common issue: large output vocabulary, computational time, and high dimensional space. |
| Approach: | They propose to make scaling factor a trainable parameter and use noise distribution to initialize output bias. |
| Outcome: | The proposed training strategies yield stable and competitive performances in small and large scale language modelling tasks. |
Semantic-aware Contrastive Learning for More Accurate Semantic Parsing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on semantic parsing use Maximum Likelihood Estimation (MLE) to train discriminative semantic parses. |
| Approach: | They propose a semantic-aware contrastive learning algorithm which can learn to distinguish fine-grained meaning representations and take the overall sequence-level semantic into consideration. |
| Outcome: | The proposed algorithm improves on two standard datasets and gets state-of-the-art performance over existing methods. |
Best Student Forcing: A Simple Training Mechanism in Adversarial Language Generation (2020.lrec-1)
Copied to clipboard
| Challenge: | Language models trained with Maximum Likelihood Estimation (MLE) have been considered as a mainstream solution in Natural Language Generation (NLG) however, they are reportedly suffering from training instability and mode collapse, and therefore outperform conventional MLE models. |
| Approach: | They propose a method to improve Generative Adversarial Nets (GANs) using best student forcing and discriminators to increase training stability and sample diversity. |
| Outcome: | The proposed techniques outperform MLE models and outperformed existing approaches in terms of sample diversity and training stability. |
Exploring the Learning Capabilities of Language Models using LEVERWORLDS (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing models of stochastic learning involve learning general structure rules and specific properties of the instance. |
| Approach: | They propose a framework that allows the generation of physics-inspired worlds that follow a similar generative process with different distributions and their instances can be expressed in natural language. |
| Outcome: | The proposed framework allows the generation of physics-inspired worlds that follow a similar generative process with different distributions and their instances can be expressed in natural language. |
CSRP: Chain-of-Thought Reasoning for Chinese Text Correction via Reinforcement Learning with Efficiency-Aware Rewards (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models lack specialized priors for subtle grammatical distinctions, and Supervised Fine-Tuning fails to optimize for precision-focused metrics. |
| Approach: | They propose a framework that builds correction capability through Continual Pre-training on 5.9M balanced samples to internalize domain knowledge. |
| Outcome: | The proposed framework outperforms existing models on the NACGEC benchmark with 50.99 F0.5 and 57.17 precision while mitigating over-correction bias. |